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Tkt  tiaplex  tlgoritha  for  tolring  liiear  prograaaing 
probloat  aay  bo  aodifiod  in  variott  ways  to  provide  algorlthat 
for  varioat  aaxiliary  parpotet.  In  partiealar,  the  ate  of  the 
daal  tyttea  alloat  arbitrary  ehaaget  to  be  aade  in  the  right 
hand  aaabart  of  the  rettraint  eqaationi.  An  allied  algoritha  — 
called  paraaatrie  linear  prograaaing  allowt  desired  changes 
to  be  introdnced  gradaally  in  sach  a  way  as  to  aaintain  feasi¬ 
bility  and  optiaality  at  all  tiaes.  Siailarly,  changes  in  the 
optiaixing  fora  can  be  aade  either  arbitrarily  or  in  sach  a  way 
at  to  aaiptain  optiaality.  If  the  siaplex  aethod  is  viewed  as 
being  coapotad  of  cartaia  rather  coaprehensive  operations,  then 
all  theta  variationt  can  be  stated  in  taras  of  the  following  set 
of  those  abstract  or  ptendo-operationt,  where  the  order  of  exe- 
catiOB  aay  vary  for  diffaraat  parpotet. 

(1>  Developaaat  of  a  pricing  vector  or  vectors. 

(2) '  Choice  of  an  index  s  of  toae  coluan  vector  P.  not 

V  s 

in  the  present  basis. 

(3)  Representation  of  the  vector  P^  in  teras  of  the 
present  basis. 

(4)  Choice  of  an  iadex  r  of  toae  coluan  P.  in  the 

^  r 

present  basis. 

(5)  Change  of  basis,  with  P  replacing  P.  ,  or  change 
of  the  right  hand  aeabers  of  the  restraint 
eqnatioas. 


It  it  taggetted  that  a  breakdown  of  this  type  has  important 
iaplicatioas  for  flexibility  and  adaptability  in  a  computer  code. 


REVISIONS  AND  EXTENSIONS  TO  THE  SIMPLEX  METHOD 
(With  Side-lights  on  Progrtmaing  Techniques) 

* 

Since  this  session  eaphnsizes  computing  techniques,  I 
will  tike  •  little  tiae  to  explain  a  problem  which  I  believe 
should  be  wore  widely  understood  by  people  who  require  large- 
scale  computations.  As  this  concerns  the  economics  of  machine 
utilization,  it  is  perhaps  not  entirely  inappropriate. 

When  the  original  foraulator  of  a  large  problem  — •  usually, 
and  hereafter,  called  the  'customer*  brings  his  monstrous 
brain  child  to  be  prepared  for  machine  calculation,  he  is  full 
of  assurances  that  this  example  is  the  forerunner  of  several 
entirely  similar  ones  for  which  the  same  program  can  be  used. 

The  customer  is  entirely  honest  in  this  but  unfortunately  what 
usually  happens  is  the  following.  Just  as  the  routine  is  nearly 
finished,  the  customer  rushes  down  with  some  'trivial*  last-minute 
changes.  These  having  been  more  or  less  graciously  accommodated 
and  the  code  finally  checked  out  on  the  machine,  it  turns  out 
that  certain  numerical  difficulties  crop  up.  Change  is  piled 
on  change  and  eventually  an  acceptable  set  of  answers  is  obtained 
but  the  code  has  lost  all  elegance  or  clarity  which  it  may  ever 
have  possessed.  In  the  meantime,  of  course,  the  customer  has 
been  pondering  deeply  over  the  imperfections  in  his  method  vhich 
these  difficulties  have  revealed  and,  when  he  presents  the  next 
example,  he  has  changed  a  few  formulas,  refined  a  few  rules, 
but  these  he  suggests  are  mere  details  which  the  coder  can 
incorporate  in  the  program  before  running  the  next  case.  At 
this  point,  the  programmer  must  consider  whether  it  is  not 
cheaper  to  start  all  over. 
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Now  having  played  both  the  role  of  progranner  and,  in  part, 
of  cnttonor,  I  have  repeatedly  been  faced  with  the  problew  of 
■akiag  extoaiive  changes  in  a  large  code.  One  attenpt  at 
Making  these  less  painful  and  less  expensive  has  cone  about 
as  a  result  of  considerable  experience  in  coding  up  routines 
for  linear  progranning  probleas  to  be  solved  with  the  slnplex 
Method  on  the  IBM  701  Qe,^.  Since  such  a  code  May  involve 
upwards  of  5000  individual  coMwands  in  its  entirety,  the  prob- 
loM  is  by  no  Means  a  siaple  one. 

One  inportant  phase  of  the  progranning  art  is  the  use  of 
what  are  called  assenbly  routines.  Since,  for  nany  reasons, 
it  is  virtually  inpossible,  in  practice,  to  write  down  the 
required  list  of  connands  in  Machine  code,  sone  sort  of  con¬ 
venient  language  internediate  between  ordinary  written  in¬ 
structions  and  Machine  connands  is  devised.  Then  a  progran 
is  prepared  at  considerable  initial  cost  —  which  can 
'read*  the  internediate  language  and  translate  it  into 
Machine  code.  Subsequent  problens  are  then  coded  in  the 
internediate  language  and,  as  a  prelininary  step  in  the  com¬ 
putations,  the  code  is  processed  by  the  assembly  routine. 
Everytine  it  is  necessary  to  re-assenble  the  code,  the  cost 
of  the  code  is  increased  by  machine  tine  as  well  as  programmers' 
tine. 

In  all  programs  which  are  to  be  assenbled,  the  notion  of 
regions  is  prominent.  A  region  is  a  group  of  consecutive  nenory 
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cells  set  aside  for  soae  sore  or  less  well-defined  set  of 
quantities  —  consiands  or  nuiibers  or  sowetiaes  both.  Regions 
are  usually  sinply  created  at  will  as  need  arises,  the  reason 
that  they  are  needed  at  all  being  that  the  logical  layout  of 
a  complex  procedure  can  be  conceptualized  only  in  terms  of 
functional  parts  that  make  up  the  whole.  Once  a  region  has 
been  coded  up  and  checked  out  (with  of  course  appropriate 
devices  for  implementing  its  use),  it  takes  on  a  new  character 
—  it  becomes  in  fact  an  abstract,  or  pseudo-operation  which 
is  henceforth  available  for  use  in  future  problems.  By  a 
pseudo-operation  is  meant  some  arithmetic,  logical,  or  utility 
activity  which  requires  more  than  one  actual  machine  order. 

For  semantic  purposes,  let  us  denote  adjustments  in  a 
program  necessitated  by  coding  errors  as  corrections,  and  those 
necessitated  by  procedural  changes  as  modifications.  Then  once 
a  particular  region  —  i.e.  a  pseudo-operation  —  has  been 
checked  out,  there  are  no  more  corrections  to  be  made  provided, 
of  course,  that  the  assumptions  on  which  it  is  based  are  always 
observed.  Now  procedural  changes  do  not  usually  involve  any 
modification  in  lower  order  pseudo-operations  such,  for  example, 
as  adding  two  vectors  together.  The  modifications  occur  —  or 
should  do  so  if  proper  planning  is  done  —  in  what  are  called 
control  regions,  the  higher  order  abstractions  which  control 
the  order  and  frequency  of  use  of  the  subservient  regions.  The 
big  difficulty  is  that  there  is  often  not  a  sufficiently  compre¬ 
hensive  picture  of  the  whole  problem  shared  by  the  customer  and 
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coder  it  the  outset  to  elloir  proper  plinning,  thot  is,  the 
control  regions  do  not  bear  the  proper  relationship  to  the  prob- 
leas  at  hand. 

At  this  point  I  aust  mention  that  it  is  possible  to  use  a 
pseudo-code  which  is  never  assembled  into  machine  language  at 
all  but  which  requires  the  use  of  an  interpretive  routine  for 
the  actual  running  of  a  problem  —  a  method  widely  practiced. 
This  interpretive  routine  usually  recognizes  some  fairly  com¬ 
prehensive  list  of  commands  but  requires  that  a  great  deal  be 
explicitly  specified  and  is  very  time-consuming  in  operation 
for  large,  special-purpose  codes.  Moreover,  extensive  changes 
are  nearly  as  difficult  in  a  universal  pseudo-code  as  in  machine 
code.  What  is  needed  is  a  pseudo-code  which  takes  advantage 
of  the  extensive  background  of  conventions  which  inevitably 
arises  in  protracted  computations  and  calculations  along  fixed 
lines.  However,  it  should  be  possible  to  couple  together  var¬ 
ious  parts  of  the  code  on  demand.  Just  as  an  interpretive 
routine  does.  In  short,  the  code  should  be  analogous  to  the 
mathematician's  thought  processes.  In  this  way  variations  in 
the  structure  of  the  main  procedure  are  easily  arranged  with  a 
minimum  of  coding  and  check-out  time,  and  time  is  not  wasted  in 
repeatedly  interpreting  the  same  thing  while  running  the  Job. 

Me  now  have  a  701  code  based  on  this  philosophy.  The  pseudo¬ 
operations  mentioned  below  reflect  its  major  structure. 

Time  limitations  force  me  to  make  the  seemingly  reason¬ 
able  assumption  that  those  interested  in  this  paper  are  already 
familiar  with  the  simplex  method.  However,  since  we  use  a 
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slightly  different  elgoritha  then  nost  others,  let  ee  Just 
briefly  sketch  the  wsy  in  which  we  set  up  the  cowputttions 
Qa,c,e,fJ.  There  is.  first  of  all,  a  linear  fora  to  be 
optimized,  and  I  will  convene  that,  as  written,  it  is  to  be 
minimized. 


(6) 


=  ain. 


This  is  to  be  done  subject  to  two  classes  of  restraints  on  the 
n  variables  xj. 


(7) 

Xjfe  0  . 

J  “  1«  •••# 

(8) 

n 

2II  ‘iJ^J 

J=1  ^ 

=  bj  .  1  =  1 

the 

ajj  and  bj  (i 

—  0,  1,  •••, 

specified  and  we  further  assuae,  without  loss  of  generality, 
that  all  the  b^  ^  0. 

Let  us  assemble  all  the  a|j  from  (6)  and  (0)  into  one 
(m’«'l) X (n<»l )  matrix  P  whose  first  column  we  make  a  unit  vector. 


(9)  P= 


1 

0 


ol 

'll 


•  •  0 


•  0  • 


on 


'In 


0 


•ml 


an 


=  [■ 


”■  P*!#  l*it  •••?  P 


■] 


The  coluans  we  have  called  Pj  (J  =0,  1,  ...,  n)  where  P^,  is 
the  unit  vector.  With  Pq  we  will  associate  a  new  variable  Xq 
and  form  the  column  of  variables 


(10)  X  =  J 


^0. 


*  .  . . , 


1 


•Braces  will  be  used  to  denote  column  vectors  and  parentheses 
to  denote  rows. 
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The  right  hand  fide  will  be  denoted  by  the  colunn  vector 


’'I®*"! . ‘••j- 

Now  the  problea  nay  be  itated  at: 

Maxiiiiae  tubject  to  (7)  and  the  watrix  eqnation 
(12)  PX  Q. 


I  will  Ignore  the  quettiont  of  deteraining  the  rank  of  P 
and  obtaining  toae  feasible  solution  to  (12),  i.e.  one  which 
satisfies  (7).  All  this  it  taken  care  of  by  phase  one  of  the 
tiaplex  aethod,  when  necessary  Qa,c:2j.  Let  us  aerely  attuae 
that  P  hat  rank  a4>l  and  that  a  basic  feasible  solution  it  at 
hand  which  consists  of  a  non-singular  basis  aatrlx  B  and  an 
associated  solution  vector  V  a  B*^Q  where 


(13) 


■■['v'l. . 


(P.  =  P-) 


it  foraed  froa  a  subset  of  the  coluans  Pj .  Let  the  values  of 
the  corresponding  variables  Xj ^  (1  =  0,  1,  ....  a)  be  V|,  with 
all  other  Xj  =  0.  That  is, 

(14)  V  =  |v^,  vj,  Vg  =  (r©  “  *o^ 

Further  denote  the  eleaents  of  B*^  by  0^^, 

(15)  B-1  =  (i^iij) 


and  any  particular  row  of  B*^  by^p 

(16)  0^  —  (^iQt  j •  •••«  * 

Note  that  the  first  coluan  of  B*^  it  alto  a  unit  vector,  that  is, 

T***  first  row  0^  of  the  inverse  is  called  a  pricing  vector. 

If  we  define 


(17) 


^ok'kj 


J  =  1. 


•  •  • ,  n 
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then  the  flrit  liaolex  criterioa  it  stated  at  follows: 

If  <  0  for  anyj,  then  the  value  of  will 

(10)  be  increased  (or  at  least  not  decreased)  if  Pj 

it  introduced  into  B. 

If  all  S.  ^  Of  then  x  =  v^  it  wax. 

J  0  0 

If  sowe  <  0,  the  usual  rule  ia  to  choose  an  index  5  by 

(19)  S  =  min  £.  <  0  taking  swallost  index  in  cate 

*  j  j 

of  ties. 

Then  P,  is  introduced  into  B.  Ip  ardor  to  choose  an  index  r  of 

tone  vector  Pj  in  B  which  P  it  to  replace,  we  express  P.  in 

r 

terws  of  B. 

(20)  B  ^Pj  =  Y  *  l^^o*  ^1*  ••••  * 

The  second  simplex  criterion  (in  i ts'^sinplif ied  forw)  it 
now  expressed  at: 

If  any  yj>  0  for  I  0, 

let  Oj  =  ^Vyj  for  those  y^  >  0  and  1>  0 
=  00  otherwise. 

(21)  Then  0  =  min  0|  taking  smallest  index  in  cate 

^  i  * 
of  ties. 

If  all  0,  then  the  value  of  x^  has  no 

upper  bound. 

Assuming  that  x^  is  bounded,  then  Pj  is  eliminated  from  B  and 
replaced  by  P,  giving,  after  the  change  of  basis,  the  new 
solution 

(22)  B(V  -  OyY)  OyPj  =  BV  =  0. 
with  a  new  value  of  x^. 


(23) 


»o  -  ®rSs  i  »o 


V 
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Those  faniliar  with  the  tiaplex  theory  will  note  that, 
in  nting  the  siaplified  second  criterion,  I  have  ignored  the 
possibility  of  endless  cycling  through  a  recurring  series  of 
bases  —  a  aatter  which  has  been  discussed  at  considerable 
length  in  various  papers  Qla,  2,  3,  4^  .  We  feel,  however, 
that  this  is  a  very  iaprobable  eventuality  there  being, to  date, 
only  two  extreaely  synthetic  exaaples  (by  Alan  Hoffaan  and 
Philip  Wdlfe)  in  which  cycling  has  occurred.  It  is  ny  view 
that  non-convergence  of  the  siaplex  iterative  process  is  only 
the  Halting  case  of  slow  convergence.  Until  we  understand 
wore  clearly  why  soae  probleas  converge  quickly  and  others  — 
which  appear  to  be  of  sinilar  structure  —  take  more  iterations, 
there  seaas  little  point  in  coaplicating  a  code  to  provide  for 
the  unlikely  ease  while  ignoring  the  aore  frequent  difficulty  of 
slow  convergence.  While  either  Dantzig's  or  Charnes*  method 
[la,2^  for  rigorously  resolving  ties  in  choosing  the  index  r 
will  prevent  absolute  degeneracy  —  nnd  hence  avoid  cycling  — 
they  still  perait  an  iapossible  nuaber  of  iterations,  froa  a 
practical  standpoint,  in  bad  cases. 

We  have  found  it  advantageous  not  only  to  transforn  Just 
the  basis  instead  of  the  whole  matrix  P  on  every  iteration,  but 
also  to  express  as  a  product  of  eleaentary  column  aatrices 
[^le,^.  These  eleaentary  aatrices  are  formed,  conceptually, 
froa  a  unit  matrix  by  replacing  the  r^*'  coluan  by  a  vector 

^  =  |\.  Ii . '!.j°  ’•r  =  *  0- 

it  is  only  necessary'^to  record  the  index  r  and  the  vector  ^  froa 
each  iteration.  This  reduces  considerably  the  amount  of  writing 


1 
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necessary  to  record  and  requires  less  rending  for  the 
first  several  iterations.  This  fora  of  the  inverse  is  also 
convenient  for  several  other  purposes*  including  calculating 
the  effects  of  various  transformations  on  a  system  a’nd  facili¬ 
tating  checking  and  restarting  procedures  —  the  latter  being 
extremely  important  in  practice.  This  product  fora  has  bean 
written  up  and  circulated  rather  widely  ^5  ^  so  that  I  shall  not 

develop  the  details  of  it  here.  It  seemed  necessary  to  remark 
on  it  however,  since  it  requires  the  redevelopment  of  the 
pricing  vector  on  each  iteration  and  certain  statements  to 
follow  might  not  be  clear  unless  this  fact  were  understood. 
Similarly,  when  a  P^  is  chosen,  it  is  still  in  its  original 
form  and  must  actually  be  transformed  into  the  vector  Y  by 
applying  B”^, 

In  the  form  which  I  have  outlined,  then,  one  iteration 
of  the  simplex  method  can  be  considered  as  consisting  of  the 
following  five  pseudo-operations. 

(i)  Develop  for  i  =  0. 

(ii)  Compute  5j  and  either  choose  a  or  terminate. 
(Optimum  attained) 

(iii)  Compute  Y  =  B"^W  for  W  =  P^. 

(iv)  Choose  the  index  r  (or  terminate  if  x^  unbounded.) 

(v)  Make  the  change  of  base,  constructing  a  new 
vector  and  transforming  V. 

As  will  appear,  this  is  a  sufficient  breakdown  of  the  whole 
complex  of  operations  to  permit  discussion  of  important  varia¬ 
tions  in  the  method. 
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The  solution  ef  •  linetr  progmaming  problea  is  often 
merely  the  first  step  in  the  inrestigition  of  o  Inrger  econoaic 
or  idainistrative  problem.  As  one  exnaple,  a  linear  prograa 
aay  contain  a  paraaeter  which  can  be  changed  to  give  different 
linear  approxiaations  to  soae  non-linear  relationship  among  the 
variables.  If  the  non-linear  function  is  continuous,  then  it 
is  expected  that  optimal  programs  will  differ  only  slightly  for 
saall  changes  in  the  paraaeter.  It  is  clearly  desirable  to  be 
able  to  introduce  slight  variations  using  a  previous  optiaal 
solution  as  a  starting  point,  rather  than  to  consider  each 
parametric  change  as  a  whole  new  prograaaing  problem. 

There  are  three  essentially  distinct  questions  of  this 
kind  each  of  which  can  be  approached  in  two  ways.  Of  the  result¬ 
ing  six  probleas,  the  following  four  are  the  most  amenable  to 
automatic  computing  schemes.  We  refer  to  these  as  post-ooti- 
mality  probleas  and  the  techniques  for  handling  then  as  para¬ 
metric  linear  prooraamino  or  PLP. 

Given  an  optimal  solution  BV  =  Q  to  the  problem  of  maxi¬ 
mising  Xq  subject  to  (7)  and  (12),  then: 

Pr.l)  How  much  can  Q  be  changed  in  some  specified  way  before 
the  basis  B  is  non-feasible,  i.e.  before  the  necessary 
change  in  V  makes  soae  v^  ^  0? 

Pr.2)  If  an  arbitrary  change  is  made  in  Q  and  the  basis  becomes 
non-feasible,  how  can  this  be  corrected  or  it  be  deter¬ 
mined  that  the  whole  new  problem  is  non-feasible? 

Pr.3)  Row  much  can  the  form  (6)  be  changed  in  some  specified 

way  before  the  solution  is  no  longer  optiaal,  i.e.  before 
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the  necessary  change  in  makes  some  S.  <  0? 

®  J 

Pr.4)  If  some  arbi trary  change  is  made  in  the  a^j*s,  how  can  this 
be  accounted  for  in  (more  particularly  in  4^)  so  that 
vectors  not  in  the  basis  —  or.  even  in  the  original  system 
—  can  be  priced  out? 

We  could  also  ask  a  pair  of  similar  questions  about  changes  in 
the  original  system  (6),  i.e.  in  the  matrix  P  with  the  zero-th 
row  and  the  sero-th  column  excepted.  However,  for  changes 
outside  the  basis  B,  the  problems  are  trivial  whereas,  for 
changes  within  B,  the  general  case  is  quite  messy.  It  is 
better  to  improvise  tricks  for  the  particular  model  at  hand  or 
else  start  all  over,  in  the  latter  case.  Consequently,  we  will 
make  no  further  mention  of  parameters  in  the  left  members  of 
the  restraint  equef.ions  although  they  are  used  fairly  frequently. 

Pr.  2  can  be  answered  very  quickly.  Simply  make  the 
desired  change  in  Q  and  re-solve  for  V.  If  the  resulting  V 
contains  no  negative  elements,  all  is  well  since,  in  any  event, 
the  pricing  vector  remains  unchanged.  Hence  we  still  have 
all  Z  0  and  the  solution  remains  optimal  as  well  as  feasible. 
If  some  Vj  ^  0,  then  apply  the  dual  simplex  algorithm  to  regain 
feasibility,  making  the  necessary  changes  of  basis.  If  this 
cannot  be  done,  then  no  feasible  solution  exists  for  the  new 
right  hand  side. 

The  dual  algorithm,  as  the  name  implies,  operates  on  the 
dual  problem,  but  does  so  in  terms  of  *he  primal  system  so  that 
all  computations  can  still  be  carried  out  in  (nh-D-space  instead 
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of  (n**'l)-ipace  which  it  typically  auch  larger  Without 

atteapting  to  reconstruct  the  theory  of  the  dual,  let  us  note 
the  following  pertinent  facts  concerning  the  complete  dualized 
systea  with  notation  consistent  with  the  abore. 


PRIMAL 

DUAL 

Objectire: 

n 

■■xl.lzc  =  -  ^  .^jXj 

a 

minimize  z  =  >  b^^ni 
i  =  l 

Feasibility: 

rj  ^  0  for  i  ^  0 

Sj  2  0  for  J  0 

Optimality: 

i  0  for  J  ^  0 

rj  i  0  for  i  ^  0 

Criterion  for 

improreaent : 

=  min  <'  0 

r^.  =  min  r^  <  0 

Criterion  for 
elimination: 

0  -  ala  (i/o) 

y  P  P 

q>  -  aln  — ^  ■  aln  -Q-j- 

Unbounded  case: 

All  y„<  0 

All  y^j  >  0 

The  dual  algoritha  can  now  also  be  stated  in  terns  of  fire  pseudo¬ 
operations  which  I  nuaber  in  a  manner  analagous  to  those  for  the 
regular  primal  algorithm. 

(iva)  Choose  the  index  r,  or  terminate.  (Optimum  attained) 
(i)  Compute  for  i  =  0  and  r. 

(iia)  Choose  0^,  or  terminate  if  no  <  0.  (Optimum 
(iii)  Compute  Y  =  B*'w  for  W  =  P^. 

(f)  Make  the  change  of  base,  constructing  a  new  rector 
and  transforming  V. 

Pr.l  i,  hindl.ri  bjr  •  .erjr  liallir  .Ijoritha  bat  Mith 
somewhat  aore  finesse.  Let  q  be  the  rector  of  changes  which 
it  is  desired  to  aake  in  Q.  Then  assume  that  an  optimum 
solution  BV  =  Q  has  been  obtained  for  the  restraints 
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(24)  PX  =  0  +  9q  (xj  >  0.  i  0) 

with  the  scalar  0  =  0.  We  now  coaipute  the  representation  of  (-q) 


PX  =  0  +  9q 


in  teros  of  B. 

(25) 


=  if  =\i,  . y^  -  . 


Using  the  sane  pseudo-operation  (iv)  as  for  the  normal  simplex 

algorithm,  we  now  compute,  proriding  any  y^  >  0, 

(26)  0_  =  min  ^i/Xj  for  yj  >  0. 

i^O 

Proceeding  as  though  we  were  going  to  introduce  (-q)  into  B 

in  place  of  P,  ,  we  have 
J  r 


(27) 


“  ®ryi^  **■  ®r<-q>  =  Q  *  0*q. 


whence  adding  0  q  to  both  sides  and  considering  that  Pi  is 

^  J  r 

really  still  in  B, 


(20) 

^  Pj^(T,  -  ery,)  +  O.Pj^  =  B(V  -  =  Q  +  «^q. 

Now  (28)  is  still  a  basic  feasible  optimal  solution  for  the 

new  right  hand  side  and  9^  is  the  greatest  value  of  9  which 

allows  this  with  the  present  basis. 

If  it  is  desired  to  change  Q  by  more  than  O^q  it  will  be 

necessary  to  change  basis  and  the  basis  vector  to  eliminate 

has  already  been  determined,  namely  Pi  since  this  is 

r 

where  the  'bind*  occurs  as  0  increases.  Hence  we  must  now 

determine  some  Pj  not  in  B  which  can  be  used  as  the  real  P^  to 

replace  Pi  and  perhaps  allow  9  to  increase  further.  Now  if 

r  r  1 

we  had  such  a  P^  with  the  representation  Xqs • ^ 1 s* *  *  * • ^ms  ’ 

it  would  be  neiessary  that  y^.^  =  ^^^Pj  ^  0*  also  wish  to 

maintain  optimality  if  possible,  that  is  feasibility  of  the  dual. 

This  means  that  the  new ^  (i.e.  the  first  row  of  B  ^  where  B 

0 
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ia  forned  from  B  by  replacing  P<  with  P  )  must  have  the 

-  * 

property  thaty^’^Pj^  0  for  J  =  1,  ...»  n.  The  rules  for 
eliaination  give 


/«P 


=  6 


Jr 


4  P 
r  s 


Hence  we  should  choose  y  <  0  since  y  =  ^  0.  From  this  it 

rs  os  9 

is  easy  to  show  that  the  index  s  is  chosen  by  the  sane  rule  (iia) 
as  was  used  in  the  straight  dual  algorithm  above.'  Hence  the  PLP 
algorithm  for  changes  in  the  right  hand  side  goes  as  follows, 
where  a  new  pseudo-operation  <vi)  is  needed. 


(iii) 

Compute  Y  =  for  W  =  (-q) . 

(iv) 

Choose  the  index  r,  or  terminate. 

(max 

9  unbounded 

with  present  B.) 

(vi) 

e 

Subtract  O^Y  from  V  and  add  O^q  to 

Q. 

(i) 

Compute  for  i  =  0  and  r. 

(iia) 

Choose  0|,  or  terminate.  (max  x^ 

unbounded  with 

present  0.) 

(iii) 

Compute  Y^  =  B"^W  for  W  =  Pj. 

(v) 

Make  the  change  of  base,  constructing  a 

new 

vector  and  transforming  V. 

/  The  following  theoren  is  of  considerable  interest 'C(^r 
this  type  of  PLP.  ^ 

Theoren;  If  the  choice  of  r  in  (26)  is  unique  (assuning 

s#ne  y^  >  0)  and 

(a)  it  ^  0  »o«®  J  =  If  •••f  "f 

then  there  exists  a  finite  range  of  0.  9  ^ 
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for  which  the  solution  obtained  by  replacing 

P.  in  B  by  P  (chosen  by  (lia))  is  both  feasible 
r 

and  optiaal;  or 

(b)  if  all  P  >  0.  then  there  is  no  feasible  solution 

rj- 

tv  Q  >  Q  , 
r 

A  constructive  proof  of  this  theorea  is  quite  straightforward 
and  even  provides  a  foraula  for  the  value  of  6  .  This  proof  can 
be  found  in  another  paper  which  I  prepared  about  a  year  ago 
and  will  be  omitted  here 

In  order  to  consider  Prs.  3  and  4,  let  us  denote  the  top 
row  of  P  —  i.e.  the  coefficients  of  and  the  aiiniBizing  form  — 
by 


^0  ”  *ol*  *o2»  ••••  ‘on^* 

If  certain  (or  all)  of  the  a^j  are  to  be  altered  by  proportionate 
amounts  9^  of  a  parameter  0,  let 

<r=  <0.^1 1^2 . ^n^ 

and  consider  the  matriA  P  as  having  |ts  top  row  given  by 

/^o  +  •  2  0- 

Let  a  given  basic  feasible  optimal  solution  to  the 
original  problem  be  BV  =  Q  which  is  then  a  solution  for  0=0. 

Now  if  0  is  increased,  B,  and  hence  is  changed.  But  due 

to  the  speqial  structure  of  B  —  i.e.  with  its  first  column 
a  unit  vector  —  the  only  change  in  B'^  will  also  be  in  its 
top  row/tfg,  or  as  ai  economist  would  say,  in  the  shadow  prices. 
This  can  be  seen  from  the  following  schematic  diagram  of  B~^ 
compared  with  B.  The  matrix  A  is  simply  B  with  its  first  row 
and  first  column  deleted. 
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Letting  correspond  to  vector  P,  in  B,  a  little  algebra 
M  •*i  - 

shows  the  new  value  of  call  it  is 


(29)  J  =  /^  -  0 
0  0 


^ . 
Ji  i 


Thus  Pr.  4  is  solved.  The  bow  pricing  vector  given  by  (29) 

0 

is  used  to  price  out  as  usual,  but  with  the  altered  cost  row,  P 

0 

that  is,  the  new  values  of  the  ,  call  them  are 

(30)  7  (P.  ♦  0r  P  )  =  F  • 

0  J  Jo  j 

Pr.  3  can  be  stated  as:  find  the  critical  value  of 
0^  0  at  which  sowe  turns  negative.  Expanding  (29)  and  (30), 
siaplifying,  and  interpreting  the  question  properly,  gives  the 
following  criterion: 


(31)  max  0=0.=  win 

J 


Vi 


-<rj 


for  denoninator>  0 


i 


If  the  danowinator  is  non-positive  for  all  j,  then  0  can  be  wade 
arbitrarily  large  and  the  present  basis  will  still  be  optiaum. 
Otherwise,  the  index  s  determines  (perhaps  not  uniquely)  a  vector 
P,  to  introduce  which  may  allow  0  to  be  increased  again.  The 
regular  primal  criterion  for  choosing *an  index  r  is  used  to 
maintain  feasibility  if  a  change  of  basis  is  to  be  made. 


i 

1 

4 

? 

1 

\ 


A 


A 

3 


V 

a 
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I  might  remark  in  passing  that  the  use  of  the  product 
form  of  the  inverse  in  machine  computations  is  ideal  for 
computing  the  row  vector  in  (29)  or  the  sum  vector  ^ 
for  use  in  the  denominator  of  (31). 

The  algorithm  for  Pr.  4  is  the  same  as  the  one  for  the 
regular  simplex  method  once  the  specified  amount  0  of  ^  has 

«l 

been  added  to  each  a^,  and  the  correction  (29)  made  in  the 

oj 

inverse.  For  Pr.  3,  we  need  only  to  substitute  the  computations 
involved  in  (31)  for  the  pseudo-operations  (i)  and  (ii),  i.e. 
we  replace  tlie  first  simplex  criterion  with  (31).  This  is  only 
to  be  expected,  of  course,  for  once  an  optimum  solution  has  been 
obtained  to  the  original  problem,  the  first  simplex  criterion 
has  nothing  more  to  offer  —  its  function  is  completed. 

In  summary,  let  me  again  re-emphasize  that  organizing 
computational  schc'tes  in  terms  Cf  fairly  comprehensive  pseudo¬ 
operations,  such  as  have  been  indicated,  is  advantageous  for 
the  coder,  the  mathematician,  and  the  economist.  There  is, 
of  course,  nothing  new  in  the  notion  either  of  regional  coding 
or  of  abstract  or  pseudo-code.  My  complaint  is  that  the  organi¬ 
zation  of  codes  into  regions  or  blocks  —  and  the  devices  used 
to  couple  them  together  and  execute  them  —  is  all  too  often 
based  on  short-view  expediency  or  established  usage  rather  than 
on  the  true  nature  of  the  problem;  for  which  the  program  is 
designed.  Furthermore,  I  suspect  that  this  is  also  true  for 
many  problem  formulations,  apart  from  whether  machine  codes  are 
written  or  not.  Mathematicians,  economists,  and  others  who  are 
potential  customers  for  the  services  of  a  machine  computing 
group  should  be  interested  in  being  as  much  as  possible  in 
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rapport  with  all  those  engaged  in  solving  their  problems.  All 
variations  to  date  on  the  basic  simplex  algorithm,  for  instance, 
can  be  expressed  in  terms  of  Just  a  few  of  our  pseudo-operations, 
very  few  more  than  we  have  already  mentioned.  Consequently,  if 
everyone's  work  is  organized  and  planned  along  these  lines,  then 
modifications  involve  only  a  reshuffling  of  large  blocks  of 
already  proven  code.  Furthermore,  this  sort  of  breakdown  enhances 
the  clarity  of  one's  insight  Into  the  theory  which  underlies  all 
these  linear  programming  techniques  —  namely  that  of  a  system 
of  linear  inequalities  in  non-negative  variables  and  its  dual. 
(Actually,  in  applying  the  simplex  method,  the  systems  are  sets 
of  linear  equalities.)  Far  example,  the  parameters  Q  and  0  which 
we  have  discussed  are  really  variables  which  are  involved  implicitl 
«  but  intimately  — >  in  any  optimization  problem  with  linear 
restraints  in  non-negative  variables.  When  working  with  feasible 
solutions  of  the  primal  system,  the  variable  Q  is  made  as  large 
as  it  is  possible  to  do  and  still  maintain  feasibility;  the 
variable  0  plays  the  same  role  for  feasible  solutions  of  the  dual. 
In  fact,  as  already  noted,  the  change  in  the  maximand  x^  for  the 
former  case  it  -0^^^  0,  whereas  the  change  in  the  minimand  z 
—  which  it  really  the  same  variable  in  the  complete  dualized 
system  is  given  by  0  in  the  latter  case.  Both  Q  and  0 

are  quotients  with  the  pivot  element,  y^^,  for  denominator  in 
either  the  regular  primal  or  straight  dual  algorithms.  When 
both  systems  are  feasible,  i.e.  when  the  whole  dualized  system 
is  optimal,  then  any  desirable  change  in  basis  can  only  give 
aaother  optimal  solution,  both  9  and  0  being  zero  and  y^^  being 
any  non-zero  number.  If  changes  are  made  in  the  right-hand 
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side  Q  or  the  cost  row  then  parametric  programming  provides 
slightly  different  formulas  for  d  or  0  to  maintain  optimality, 
at  discussed  above. 

To  conclude,  the  complete  dualized  system  is  displayed 
in  a  form  consistent  with  the  preceding  notation  and  arrange¬ 
ment  of  the  original  problem.  For  simplicity,  it  has  been 
assumed  that  the  basis  B  consists  of  the  first  nH*!  columns 
of  P.  It  is  hoped  that  a  careful  perusal  of  this  tableau 
will  be  as  helpful  to  those  readers  who  have  not  yet  consider¬ 
ed  it  as  it  has  been  to  me  in  observing  the.  remarkable 
relationships  that  exist  in  the  type  of  problems  with  which 
we  have  been  concerned.  A  full  explanation  of  these  relation¬ 
ships  which  the  tableau  is  intended  to  display  can  be  found 
in  reference  . 


TEI  COMFLin  DOALIZID  STSTBI  FOR  THB  SIMPLEX  METHOD. 
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Iot«:  Th«  dual  baals  (for  a-fl  spaca)  oosisiats  of  all  roira  In  tha  big  i^ln 
(ft4>l)I(n4»fl)  aatrlz  azcapt  thoaa  oultlpllad  bj  5.,  ....  5_  (all  zaro). 

X  B 

Itakliig  a  ohaxiga  la  tha  prlaal  baata  —  F  raplaclag  P.  —  lapllaa  a  eor- 

■ 

raapoBdlag  chaaga  la  tha  dual  basis  —  tha  rov  aultlpllad  by  5.  raplacing 
tha  oaa  aultlpllad  by  b^^assualng  tha  aatrlz  P  has  rank  b>1  and  that  oxks 
starts  vlth  a  basic  solutioa  to  tha  prlual  aystau. 
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